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We study the Bayesian problems of detecting a change in the drift rate of an observable 
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diffusion process with linear and exponential penalty costs for a detection delay. The 



optimal times of alarms are found as the first times at which the weighted likelihood ratios 
hit stochastic boundaries depending on the current observations. The proof is based on 
the reduction of the initial problems into appropriate three-dimensional optimal stopping 
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J> ■ problems and the analysis of the associated parabolic-type free-boundary problems. We 
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provide closed form estimates for the value functions and the boundaries, under certain 
nontrivial relations between the coefficients of the observable diffusion. 



1. Introduction 

The problem of quickest disorder detection for an observable diffusion process seeks to 
determine a stopping time of alarm r which is as close as possible to the unknown time of 
disorder (or change-point) 9 at which the local drift rate of the process changes from /zo(') to 
In the classical Bayesian formulation, it is assumed that the random time 9 takes the 
value with probability ir and is exponentially distributed with parameter A > given that 
9 > 0. An optimality criterion was proposed in for the time of alarm to minimize 

a linear combination of the false alarm probability and the expected time delay in detecting 
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the disorder correctly, for sequences of i.i.d. observations. An explicit solution of the problem 
of detecting a change in the constant drift rate of an observable Wiener process with the 
same optimality criterion was derived in [25j-[26j. The appropriate optimal stopping problem 
for the posterior probability of the occurrence of disorder was reduced to the associated free- 
boundary problem for an ordinary differential operator (see also [271 Chapter IV, Section 4] or 
[TTj Chapter VI, Section 22]). A finite time horizon version of the Wiener disorder problem 
was studied in [9]. 

The idea of replacing the initial average time delay by a certain non-additive detection 
delay penalty criterion was originally introduced in [21]. The resulting Bayesian risk function 
was expressed through the current state of a multi-dimensional Markovian sufficient statistic 
having state space components which are different from the posterior probability. Such a process 
contained all the necessary information to determine the structure of the optimal time of alarm 
(see also more recent works [29], [30] and [6]). In the case of exponential penalty costs for a 
delay, it was observed by Poor [18] that the weighted likelihood ratio process turns out to be 
a one- dimensional Markovian sufficient statistic, for sequences of i.i.d. observations. This idea 
was taken further by Beibel [I], who solved the corresponding problem of detecting a change 
in the drift rate of an observable Wiener process as a generalized parking problem. Bayraktar 
and Dayanik [1] recognized the same property from the structure of the ordinary differential- 
difference equation in the free-boundary problem associated with the Bayesian problem of 
detecting a change in the constant intensity rate of an observable Poisson process. Some 
other formulations of the problem for the case of detecting a change in the arrival rate of a 
Poisson process, leading to the appearance of essentially multi-dimensional Markovian sufficient 
statistics, were studied by Bayraktar, Dayanik, and Karatzas [2]- [3]. Extensive overviews of 
these and other related quickest sequential change-point detection methods were provided in 
the monographs |28j and |19j . 

In the present paper, we study the Bayesian quickest disorder detection problems for observ- 
able diffusions with linear and exponential delay penalty costs. We reduce the initial problems 
to extended optimal stopping problems for three-dimensional Markov diffusion processes, hav- 
ing the posterior probability, weighted likelihood ratio, and the observations as their state space 
components. We show that the optimal stopping times are expressed as the first times at which 
the weighted likelihood ratio processes hit stochastic boundaries depending on the current state 
of the observation process only. We verify that the value functions and the optimal stopping 
boundaries are characterized by means of the associated free-boundary problem for a second- 
order partial differential operator. The latter turns out to be of parabolic type, because the 
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observation process is a one-dimensional diffusion. We also derive closed form estimates for 
the value functions and the boundaries for a special nontrivial subclass of observable diffusions. 
The Bayesian sequential testing problem for such processes was recently solved in [10] . Another 
related problem of transient signal detection and identification of two-sided changes in the drift 
rates of observable diffusion processes was considered by Pospisil, Vecer and Hadjiliadis [20] . 

The paper is organized as follows. In Section 2, we formulate the Bayesian quickest disorder 
detection problem for observable diffusion processes with linear and exponential delay penalty 
costs and construct the associated multi-dimensional optimal stopping problem. In Sections 3 
and 4, we present the associated free-boundary problem and reduce the resulting parabolic-type 
partial differential operator to the normal form, which is amenable for further considerations. 
Applying the change-of- variable formula with local time on surfaces, obtained by Peskir [16] , 
we verify that the solution of the free-boundary problem, which satisfies certain additional 
conditions, provides the solution of the initial optimal stopping problem. We derive closed form 
estimates for the value function and the boundary, which are uniquely determined as solutions 
of ordinary differential equations, under certain nontrivial relations between the coefficients of 
the observable diffusion. The main results are stated in Theorems 3.4 and 4.2. 



2. Preliminaries 

In this section, we give the Bayesian formulation of the problem (see [271 Chapter IV, 
Section 4] or [T7J Chapter VI, Section 22] for the case of Wiener processes) in which it is 
assumed that one observes a sample path of the diffusion process X = (X t ) t > with the drift 
rate changing from /io(-) to /xi(-) at some random time 9 taking the value with probability 
7r and being exponentially distributed with parameter A > under 9 > . 

2.1. (Formulation of the problem.) Suppose that, on a probability space (fl, J 7 , P n ) , there 
exists a standard Brownian motion B = (B t )t>o independent of a nonnegative random variable 
9 such that P w (6 = 0) = tc and P 7T (9 > t \ 9 > 0) = e~ xt , for all t > and some A > fixed. 
Let X = (Xt)t>o be a continuous process solving the stochastic differential equation: 

dX t = (fi (X t ) + 1(9 < *)(/zi(X t ) - fio(Xt))) dt + a(X t ) dB t (2.1) 

with X = x, where fii(x) , i — 0, 1 , and a(x) > are some continuously differentiable functions 
on (0,oo), satisfying the conditions: 

(JLi(x) - Hq(x) 



\fii(x)\ + \a(x)\ < K(l + \x\) and 0< 



a(x) 



< K (2.2) 
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for all x > and some K > fixed. In order to facilitate the considerations of the examples 
below, we assume the state space of the process X to be the positive half line (0, oo) . It 
thus follows from [HI Theorem 4.6] that the equation in ( 12. ip admits a unique strong solution 
under 9 = s, and hence, P^X G • | 9 — s) — P S (X G ■ ) is the distribution law of a time- 
homogeneous diffusion process started at some x > 0, with diffusion coefficient o~(x) and the 
drift rate changing from fio(x) to fii(x) at time s G [0, oo] . In this case, we may conclude that 
the probability measure P n has the structure: 



for any tt G [0, 1) fixed. 

Based upon the continuous observation of the process X , our task is to find among the 
stopping times r of X (i.e. stopping times with respect to the natural filtration Tt = <j{X s | < 
s < t) of the process X) an optimal time at which an alarm should be sounded as close as 
possible to the unobservable time of disorder 9 . More precisely, the Bayesian quickest detection 
problem consists of computing the Bayesian risk function: 



and finding the optimal stopping time, called the 7r-Bayesian time, at which the infimum is 
attained in ( 12. 4p . Here P n (r < 9) is the probability of a. false alarm, and E n [F(r — 9)I(r > 9)] 
is the expected costs of delay in detecting of the disorder correctly (i.e. when r > 9), where 
the delay penalty function F(t) satisfies the conditions F(t) > for t > 0, and F(t) = for 
t < 0. We will further assume that either F(t) = ct or F(t) = c(e at — 1) holds in (12 .4p for all 



Remark 2.1. It was shown in [23], [29] and [6] that, when the Laplace transforms of de- 
lay penalty functions are of rational structure, there exist finite-dimensional processes called 
Markovian sufficient statistics in the corresponding Bayesian quickest detection problems. Such 
(time-homogeneous strong) Markov processes containing all the necessary information to de- 
termine the optimal stopping times (see [271 Chapter II, Section 15] for an extensive discussion 
of this notion). For example, the function F(t) = ct 5 for t > 0, with some c, 5 > 0, 5 G N, 
is of such type, while the assumption S ^ N leads to the appearance of an infinite-dimensional 
Markovian sufficient statistic in that case. 

2.2. (Likelihood ratio and posterior probability.) In order to derive Markovian sufficient 
statistics for the problem of ( 12. 4p . for the cases of linear and exponential delay penalty functions 




(2.3) 



V(tt) = mf (p^t <9) + E w [F(r - 9)I(r > 9)]) 



(2.4) 



t > 0. 
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indicated above, let us define the posterior probability process (fit)t>o by 7r t = P(6 < 1 1 Ft) for 
t > . Taking into account the fact that the probability measure P s is equivalent to P n on Ft 
by construction, for any s G [0, oo] , using Bayes' formula (see, e.g. [HI Theorem 7.23]), we get 
that (^t)t>o admits the representation: 

d(P° | F t ) ^ . /■* d(P s | F t ) x _ As , 
Moreover, since the measure P M coincides with P* on Ft-, for all < t < u, we see that: 

is satisfied. By means of Girsanov's theorem for diffusion processes (see, e.g. [IJJ Theo- 
rem 7.19]), it follows from the structure of the observation process X in (12. ip that the likelihood 
ratio process L = (L t ) t >o defined by: 



_ d(P° | F t ) __ ki / | j 1 1 , 



d(p°\ 


Ft) 


d(P°° 


\?t) 



admits the representation: 



= exp U " 5 X d 7 ' (2 ' 8) 

Hence, the expressions in (12. 7p and (12. 8p yield that the properties: 

d(P s \F t ) d(P n | F t ) = d(P s | Ft) d(P° | Ft) = d(P s \F s ) d(P°\F t ) _ Lt_ , . 
d(P n | Ft) | Ft) d(P° | 7i) | F t ) d(P° | J- s ) | J 7 *) ~~ L s 1 ' j 

hold for each < s < t. We therefore obtain from the representations in (I2.5P and (12. 6p that 
the weighted likelihood ratio process {ft)t>o defined by ip t = ^/(l — ^t) has the form: 



as 



2.3. (Stochastic differential equations.) Applying Ito's formula (see, e.g. [HJ Chapter IV, 
Theorem 4.4] or [2TJ Chapter IV, Theorem 3.3]) to the expression in ( 12. 8p . we get that the 
process L admits the representation: 

dU = /il(Xf) 2 7/° (Xt) L t (dX t - M*t) dt) (2.11) 
® \ t) 

with Lq = 1. Then, using the integration by parts formula, we see that the process (ft)t>o 
from ( 12.1 Op solves the stochastic differential equation: 



fii(X t ) - no(X t )\ (ft \ j. , Hi(X t ) - IM){X; 



^,HA(l + - j rf -j rff+ --— ^ 5, (2,2) 
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with (f = (p = it / (1 — 71") . Hence, using Ito's formula again, we obtain that the process (TT t )t>o 
admits the representation: 

d* t = A(l - n t ) dt + 7T t (l - 7T t ) cS t (2.13) 
with 7To = 7r. Here, the innovation process B = (B t )t>o defined by: 

B , = f _ /* (mgt + ds (2 . 14) 



is a standard Brownian motion under the measure P^, with respect to the filtration (J^tjtto, 
according to P. Levy's characterization theorem (see, e.g. [Ht Theorem 4.1] or [2H Chapter IV, 
Theorem 3.6]). It thus follows from ( 12.141) that the process X admits the representation: 

dX t = (fi Q (X t ) + 7t t (/i^Xt) - fM>(X t ))) dt + a(X t ) d~B t (2.15) 

with X = x. Taking into account the assumptions in (12. 2p . we may conclude by virtue of 
Remark to [HJ Chapter IV, Theorem 4.6] (see also [H2 Chapter V, Theorem 5.2.1]) that the 
processes fa,X t ) t > and ((p t ,X t ) t > turn out to be unique strong solutions of the correspond- 
ing systems of stochastic differential equations in (12. 12ft . ( 12. 13ft . and ( 12.151) . According to 
[T5| Chapter VII, Theorem 7.2.4], such processes have the (time-homogeneous strong) Markov 
property with respect to its natural filtration, which inherently coincides with (J-t)f>o- 

2.4. (Some examples.) Let us now present some expressions for the Bayesian risk func- 
tions and the appropriate Markovian sufficient statistics in the corresponding quickest disorder 
detection problems for observable diffusion processes. 

Example 2.2. Assume that we have F(t) = ct with some c > fixed (see [25], [26] . 
[27j Chapter IV], and [171 Chapter VI, Section 22]). It is then shown by means of standard 
arguments from j27J Chapter IV, Section 3] that the Bayesian risk function V(tt) in (12.41) admits 
the representation: 



V'(tt, ip, x) = inf E. 



1 - 7T T + / (1 — 71*) ap t dt 



(2.16) 



where the infimum is taken over all stopping times r such that E n ^ iX T < oo holds. Here, P^^x 
is a measure of the diffusion process fa, ft, X t ) t > , started at some (tt, <p, x) G [0, 1) x [0, oo) x 
(0, oo) and solving the equations in ( 12. 12ft . ( 12 . 13j) . and ( 12. 15ft . which is a Markovian sufficient 
statistic in the problem. 
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Example 2.3. Assume now that F(t) = c(e at — 1) with some c, a > fixed (see (2U 
Example 4], [18], jl], and [1]). It can be shown following the schema of arguments from [1] that 
the Bayesian risk function V(ir) in C I2 .41) admits the representation: 

V*(7r,0,x) = inf E n4>x 

T 

where the infimum is taken over all stopping times r such that the integral above has a finite 
expectation, so that E^^t < oo holds. Here, the weighted likelihood ratio process (<fit)t>o 
defined by: 

<f> t = e^L t l-^- + J ds) (2.18) 

solves the stochastic differential equation: 

AA, \A . /ft(^H#t)V A , ^l(X t ) -^o(X f ) — 

# f = A + (A + a) <pt + tttt ir t <Pt) dt-\ — — <p t dB t (2.19) 

V V <r{X t ) J J a(X t ) 

with <pQ = (f> = — . In this case, P^^x is a measure of the diffusion process (ii t , t , X t ) t > , 
started at some (ir,4>,x) G [0, 1) x [0, oo) x (0, oo) and solving the equations in (12.131) . (I2.19p . 
and (I2.15p . which is a Markovian sufficient statistic in the problem. 



1 — 7T T + / (1 — 7T t ) CCUpt dt 
'0 



(2.17) 



3. The case of exponential delay penalty costs 

In this section, we formulate and prove the main assertions of the paper, which are related 
to the quickest detection problem with exponential delay penalty costs of Example 2.3 above. 

3.1. By means of the results of general theory of optimal stopping (see, e.g. [271 Chapter III] 
or [T7J Chapter I, Section 2.1]), it follows from the structure of the reward functional in ( I2.17P 
that the optimal stopping time is given by: 

r. = infO > | Kfa, fa, X t ) = l- n t } (3.1) 

whenever the corresponding integral there is of finite expectation, so that E^^t* < oo holds. 
In order to specify the structure of the stopping time in (13. lft . we follow the arguments from 
[HI Subsection 2.5] and use Ito's formula to get: 

l-7r t = l- 7r- /" \{l-n s )ds + N t (3.2) 
where the process iV = (N t ) t > defined by: 



o 



N t = - \ /flW^W Ks{1 _ Ks) d B s (3.3) 



o 



ct(X s ) 
7 



is a continuous local martingale under P n ^, x . It follows directly from (13 .2D that the process 
(N TA t)t>o is a uniformly integrable martingale for any stopping time r satisfying E n ^ x r < 
oo. Then, applying Doob's optional sampling theorem (see, e.g. [HI Theorem 3.6] or [2T| 
Chapter II, Theorem 3.2]), we get from the expression in (13.21) that: 



E. 



1 - 7T T + / (1 — 7r t ) ca(f> t dt 



1-ir + E. 



, V l - -,) {C(\Ol 





A) dt (3.4) 



holds for all (ir,<fi,x) G [0,1) x [0, oo) x (0, oo) and any r such that E^^r < oo. Taking 
into account the structure of the reward in (12. 17ft . it is seen from ( 13 Ah that it is never optimal 
to stop when <p t < X/(ca) for any t > 0. This shows that all the points (ir, 0, x) such that 
< A/(ca) belong to the continuation region: 



= {(vr, 0, x) G [0, 1) x [0, oo) x (0, oo) | V*(ir, 0, x) < 1 - vr}. 



(3.5) 



3.2. In order to describe the structure of the set in ( 13.51) . let us fix some (it, <p, x) G C* and 
denote by = t*(7t, 0, x) the optimal stopping time in the problem of (I2.17p . Then, by means 
of the general optimal stopping theory for Markov processes (see, e.g. [271 Chapter III] or JT7J 
Chapter I, Section 2.2]), we conclude that: 



V*(TT,<j),x) = E^ Ax 



ir t ) caipt dt 



< 1 - 7T 



(3.6) 



holds. Hence, taking any 0' such that 0' < and using the explicit expression for the process 
(0t)t>o through its starting point = 7r/(l — ir) in ( 12.181) . we obtain from (12. 17D that the 
inequalities: 



14(77, (f)',x) < E n ^> 

< Eyr A, , 



1 - TTr, + 



[1 — 7T t ) ca4>t dt 







(3.7) 



ir Tt + / (1 - 7r t ) ca<f) t dt 
'o 



are satisfied. Thus, by virtue of the inequality in ( 13.61) . we see that (ir, 0', x) G C*. Taking 
into account the multiplicative structure of the integrand in (I2.17p . we can therefore extend 
the approach used in [18], [1], and PQ, and further assume that there exists a function g*(x) 
such that < \/{ca) < g*(x) for x > 0, and the continuation region in (I3.5P for the optimal 
stopping problem of (12. 1 7D takes the form: 



C* = {(-7r, 0, x) G [0, 1) x [0, oo) x (0, oo) I < g*(x)} 
so that the corresponding stopping region is the closure of the set: 

A, = {(vr, 0, x) G [0, 1) x [0, oo) x (0, oo) | > g*(x)}. 



(3.8) 



(3.9) 



S 



3.3. In order to characterize the behavior of the boundary g*(x) in (13.81) - ( [3T9T) . we observe 
from the equation in ( 12. 191) that the expression: 

*(l-7r t )<M*= r\pp-d<k- r i -f^(\ + P (X t )n t <p t )dt + Nl (3.10) 
Jo A + a J A + a 

holds for the optimal stopping time r* = r*(7r, <f>, x) in (12.171) such that (ir,<f>,x) £ C*. Here, 
the process iV* = (Nl) t > defined by: 

N t =- / — — ——4> s dB s (3.11) 

J o-(X s ) A + a 

is a continuous local martingale under P^^x, and p(x) is the so-called signal/noise ratio func- 
tion given by: 



Hi(x) - n (x) 



2 



for any x > . Observe that the assumption that the integral in ( 12.17ft taken up to the optimal 
stopping time r* is of finite expectation and the third inequality in (12.2ft yield that the integral 
in the left-hand side and the second integral on the right-hand side of ( 13.10ft are of finite 
expectation too. Then, taking into account the fact that < 7i t < 1 holds for all t > 0, and 
assuming that the process (iV*„ At )t>o is a uniformly integrable martingale under P n ^ x (which 
is the case for the process (M r „ Ai ) t >o from (13. 37ft under the conditions of Lemma 3.3 below), 
by means of Doob's optional sampling theorem, we get from the expression in ( 13 .101) that: 

E%,<f>,x (1 - 7r t ) 4>tdt = E w ^ x - d<j>t - $ x / — — - (A + p(X t ) ir t (fit) dt (3.13) 

Jo Jo A + a J A + a 

is satisfied. Let us now take x' > such that x < x' and recall the fact that (71* , (fit, X t )t>o is 
a time- homogeneous Markov process. Assume that (71*, <fi, x) £ C* is chosen sufficiently close to 
the stopping boundary g* (x) , and note that Tip. Tip (n,<fi,x) does not depend on x* . Hence, 
applying the comparison results from [31] for solutions of stochastic differential equations, we 
obtain that the expression in ( 13. 13ft yields that: 



V*(ir,(fi,x') < E n ^ x , 

^ Ptt,4),x 



1 - 7T T , + / (1 - 7T t ) ca(fi t dt 

Jo 

1 — 7T T , + / (1 - 7Tt) cacfit dt 
Jo 



(3.14) 

V*(TT,<f>,x) 



holds, whenever p(x) is an increasing function on (0, 00) . By virtue of the inequality in (13.141) . 
we may therefore conclude that (n,(fi, x') £ C*, so that the boundary g*(x) is increasing 
(decreasing) in (I3.8l) - ()3.9p whenever p(x) is increasing (decreasing) on (0, 00), respectively. 
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Summarizing the facts proved above, we are now ready to formulate the following assertion. 

Lemma 3.1. Suppose that fii{x) , i = 0, 1, and o~(x) > are continuously differentiable 
functions on (0, oo) in A2. 1\) satisfying /12.2\) . Assume that the process (N* tM ) t > from /13.11\) is 
a uniformly integrable martingale. Then the optimal Bayesian time of alarm r* in the quickest 



disorder detection problem of ( 2.11 ) has the structure: 



T* = mf{t>0\<f> t >g*{X t )} (3.15) 

whenever the corresponding integral has finite expectation, so that E n> ^ )X r^ < oo holds, for all 
(vr,0, x) G [0,1) x [0, oo) x (0,oo), and r* = otherwise. Moreover, the property: 

g*(x) : (0, oo) — > (A/(cot),oo) is increasing/decreasing if p(x) is increasing/decreasing (3.16) 

holds with p(x) defined in A3. 12}) . for all x > . 

3.4. By means of standard arguments based on the application of Ito's formula, it is shown 
that the infinitesimal operator L^^x) of the process (irt, <fit, X t )t>o from ( 12.131) . ( 12. 19ft . and 
( 12 . 151) has the structure: 

W, = A(l - «) I + (A + (A + „) , + (^fM) 2 , *) £ ,3,7, 

d ( d 2 d 2 

+ (tMi(x) + (ni(x) - imo(x)) vr) — + (/ii(x) - iia(x)) n(l - vr) — — + 



dx \ dndx d(pdx 

1 / fix(x) - hq(x)\ 2 f 2 2 d 2 d 2 2 d 2 \ 1 2 f s d 2 

+ 7C 7 \ 7T 1 - 7T — - + 2lX 1 - 7T) - — + —-r + - (7 (x) 



2 \ a(x) J \ dix 2 dird(f) d(f) 2 J 2 dx 2 

for all (tt, 0, x) G [0, 1) x [0, oo) x (0, oo) . 

According to the results of the general theory of optimal stopping problems for continuous 
time Markov processes (see, e.g. [TT], [27J Chapter III, Section 8] and [TT] Chapter IV, Sec- 
tion 8]), we can formulate the associated free-boundary problem for the unknown value function 
K(vr,0, x) from ( 12.171) and the boundary g*(x) from ( 13. 15ft : 

(L (7r ^ iX) V r )(vr, 0, x) = -(1 - 7r) cacj) for (vr, 0, x) G C (3.18) 

V(7r, 0, a;)|^_ , = 1 — 7r {instantaneous stopping) (3.19) 

V{ir, , x) = 1 - tt for (tt,0,x)g j D (3.20) 

V(tt,0,x) < 1 -vr for (tt,0,x)gC (3.21) 

where C and -D are defined as C* and -D* in (13.81) and (13.91) with g(x) instead of g*(x), and 
the condition in (13 . 1 9[) is satisfied for all tt G [0, 1) and x > 0. 
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Note that the superharmonic characterization of the value function (see [7J, j27J Chapter III, 
Section 8] and [T7J Chapter IV, Section 9]) implies that V*(ir,({), x) from (12. 1 Tl) is the largest 
function satisfying (13. 18[) -( l372Tj) with the boundary g*(x) . 

Remark 3.2. Observe that, since the system in (I3.18[) -( l3.21[) admits multiple solutions, we 
need to find some additional conditions which would specify the appropriate solution providing 
the value function and the optimal stopping boundary for the initial problem of (12 . 1 7[) . In order 
to derive such conditions, we shall reduce the operator in (13.1 7ft to the normal form. We also 
note that the fact that the stochastic differential equations for the posterior probability, the 
weighted likelihood ratio, and the observation process in (12. 13f) . (12. 19}) . and (I2.15p . respectively, 
are driven by the same (one-dimensional) innovation Brownian motion yields the property that 
the infinitesimal operator in (13. 1 7[) turns out to be of parabolic type. 

3.5. In order to find the normal form of the operator in (13 . 1 7|) and formulate the appropriate 
optimal stopping and free-boundary problem, we use the one-to-one correspondence transfor- 
mation of processes proposed by A.N. Kolmogorov in [12]. For this, let us define the process 
Y = (r t ) t >o by: 



y t = log. 



Hx[w) 



a 2 (w) 



dw 



(3.22) 



for all t > , and any z > fixed. Then, taking into account the assumption that the functions 
/ij(x), i = 0,1, and cr{x) are continuously differentiable on (0, oo), by means of Ito's formula, 
we get that the process Y admits the representation: 



dY* 



+ \ + a i— ^ 



dx 



Hx{x) - ii Q (x) 



<j 2 (x) 



x=X t 



with Y = y and 



y = log < 



Hx{w) - Ho(w) 



a 2 (w) 



dw 



\dt (3.23) 



(3.24) 



for any z > fixed. It is seen from the equation in (13.231) that the process Y started at y E R 
is of bounded variation. By virtue of the second inequality in (12. 2p . it follows from the relation 
in (13.221) that there exists a one-to-one correspondence between the processes (7r,0, X) and 
(-7T, (f), Y) . Hence, for any z > fixed, the value function V*(tt, (ft, x) from (12.171) is equal to the 
one of the optimal stopping problem: 



^(tt, 0, 2/) = mfE^y 



7T r + 



it t ) ca(f) t dt 



(3.25) 



where the infimum is taken over all stopping times r such that the integral is of finite expecta- 
tion, so that En^yT < oo holds. Here, P n ,(t>, y is a measure of the diffusion process (-7r t , (fi t , Y t ) t > , 
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started at some (it, 4>,y) £ [0, 1) x (0, oo) x M. and solving the equations in (I2.10j) . (12. 18ft . and 
( 13. 22 p . It thus follows from (l3.8p -( }3T9l) that there exists a continuous function h*(y) such that 
< X/(ca) < h*(y) holds for y £ R, and the optimal stopping time in the problem of ( 13. 25ft 
has the structure: 

r*=inf{t >O|0 t >h*(Y t )} (3.26) 

whenever the corresponding integral is of finite expectation, so that E^fayT* < oo holds, and 
r* = otherwise. 

3.6. Standard arguments then show that the infinitesimal operator Ljy^y) of the process 
(ir,<f>,Y) from (127L31) . (T2TT9|) . and (13T23D has the structure: 



d 

M*4,Y) = A(l - tt) — + ( A + (A + a) + 



Hx(x((j),y)) - Ho{x{<f>,y)) 



1 / fii(x{<l>,y)) - Ho{x{(j),y)) 
a(x((j),y)) 

a 2 (x(<f),y)) 



71 (1 - 7r) 



92 



+ 2vr(l - tt) 



7T 



<9 



(3.27) 



9 2 



dird(j) 



+ 



90 s 



+ 



A 



+ A + a 



l4(x{<j>,y))- f4(x(<p,y)) d ( Hi(x) - // (x) 



+ 



<t 2 (x) 



x=x((j),y) 



d_ 

dy 



a 4 (x((J),y)) dx 

for all (ir,(f>,y) £ [0,1) x (0, oo) x R. Here, because of the second inequality in (12. 2p . the 
expression for x((f),y) = x(4>,y;z) is uniquely determined by the relation in ( I3.24p . for any 
z > 0. 

We are now ready to formulate the associated free-boundary problem for the unknown value 
function U*(7T,(f>,y) = U*(tt, 0, y; z) from ( I3.25|) and the boundary h*(y) = h*(y; z) from (I3.26[) : 

{h {n ^ Y) U){ir,<j),y) = -(1-tt)c«0 for < h{y) (3.28) 



4>=h(y)- 



1 — 71 (instantaneous stopping) 



(3.29) 

U(tt, 0, y) = 1 - tt for > %) (3.30) 
C/(tt, 0, y) < 1 - tt for < h(y) (3.31) 

where the condition in (13.291) is satisfied for all 7r £ [0, 1) and y £ R. Moreover, we assume 
that the following conditions hold: 

dU 



Tr-(7T,0,1/) 



(smooth fit) 



4>=h(y)- 



</>=0+ 



and the one-sided derivative: 

dU 



dy 



n,<f>,y) 



is finite 



exists 



(3.32) 
(3.33) 

(3.34) 



4>=h(y)- 
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for all 7r £ (0, 1) , y £ R, and any z > fixed. 

We further search for solutions of the parabolic-type free-boundary problem in fl3.28p -f l3.3ip 
satisfying the conditions in f l3.32p - fl3.34p and such that the resulting boundaries are continuous 
and of bounded variation. Since such free-boundary problems cannot, in general, be solved 
explicitly, the existence and uniqueness of classical as well as viscosity solutions of the related 
variational inequalities and their connection with the optimal stopping problems have been 
extensively studied in the literature (see, e.g. [8], [5], p2] or pj)]). It particularly follows from 
the results of [El Chapter XVI, Theorem 11.1] as well as [131 Chapter V, Section 3, Theorem 14] 
with [131 Chapter VI, Section 4, Theorem 12] that the free-boundary problem of fl3.28p -f l3.3ip 
with fl3.32p - fl3.34p admits a unique solution. 

3.7. We continue with the following verification assertion related to the free-boundary 
problem in fl3T28]) - fl3T34l) . 

Lemma 3.3. Suppose that Hi(x) , i = 0,1, and o~(x) > are continuously differentiable 
functions on (0, oo) in Ii2.1\) satisfying Ii2.2\) . Assume that the function U(n, (fi,y; h*(y)) 
; 1 — ii)H((f), y; h*(y)) and the continuous boundary of bounded variation h*(y) form a unique 
solution of the free-boundary problem in \3. 28\) - f3. 31\) satisfying the conditions of Ii3.32\) - I^3.34\ )- 
Then, the value function of the optimal stopping problem in k3. 25\) takes the form: 



and h*(y) provides the optimal stopping boundary for ^3. 2(A) . whenever the corresponding inte- 
gral is of finite expectation, so that E^^r* < oo holds, for all (tt, <fr, y) £ [0, 1) x (0, oo) x IR. 

Proof. Let us denote by U(n,(p,y) the right-hand side of the expression in (I3.35p . Hence, 
applying the change-of-variable formula with local time on surfaces from [16] to U(7r, 0, y) and 
h*(y), and taking into account the smooth-fit condition in (I3.32p . we obtain: 




(3.35) 




(3.36) 



where the process M = (M t ) t > defined by: 




(3.37) 



is a continuous local martingale under 



P-kAv witn res P ect to (Ft)t>Q- 
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It follows from the equation in (13. 28ft and the conditions of (I3.30l) - (l3.31ft that the inequality 
(L( n ^Y)U)(7r,cj),y) > —(1 — n)ca(j) holds for any (ir,<f),y) G [0,1) x (0, oo) x R such that 
4> 7^ h*(y), as well as U(ir,<fi,y) < 1 — n is satisfied for all (ir,<f),y) G [0,1) x (0, oo) x R. 
Recall the assumption that the boundary h*(y) is continuous and of bounded variation and the 
fact that the process Y from ( 13.22ft is of bounded variation too. We thus conclude from the 
assumption of continuous differentiability of the functions fii(x) , i — 0,1, and <j(x) that the 
time spent by the process (<f>t)t>o at the boundary h*(Y) is of Lebesgue measure zero, so that 
the indicator which appears in ( 13. 36ft can be ignored. Hence, the expression in (13.36ft yields 
that the inequalities: 

(•T 

(3.38) 



1 - 7T T + / (1 - 7T t ) ca(j) t dt 

Jo 

> U (tt t , <f> T , Y T ) + / (1 - 7T t ) ca<p t dt>U (tt, 0, y) + M T 



hold for any stopping time r of the process (tt, 4>, Y) started at (tt, (f), y) G [0, 1) x (0, oo) x R. 

Let (r n ) neN be an arbitrary localizing sequence of stopping times for the processes M. 
Taking the expectations with respect to the probability measure P n ,<f>, y in f !3.38|) . by means of 
Doob's optional sampling theorem, we get that the inequalities: 

ctAt„ 



E 



7T 



tAt„ 



> E. 



U(TT rATn ,(f). 



(1 — 7T t ) CCt(j) t dt 
-tAt„ 



(3.39) 



tAt„ , VtAt„ , 1 tA 



(1 — 7T t ) cacj) t dt 
> U (tt, 4>, y) + E^ Ay [M rATn ] = U (vr, 0, y) 

Hence, letting n go to infinity and using Fatou's 



hold for all (ir,(j>,y) G [0,1) x (0, oo) x 
lemma, we obtain: 



> E. 



1 - 7T T + 



[1 — 7T t ) cafa dt 



(3.40) 



U(7T T ,(p T ,Y T ) + / (\--K t )ca<t>tdt 



>U(TT,(f>,y) 



for any stopping time r and all (7r, 0, y) G [0, 1) x (0, oo) x R. By virtue of the structure of the 
stopping time in (I3.26p . it is readily seen that the inequalities in (I3.40p hold with r* instead of 
r when <fi > h*(y) . 

It remains to show that the equalities are attained in (13.401) when replaces r, for 
(TT,(j),y) G [0,1) x (0, oo) x R such that cf) < h*(y). By virtue of the fact that the func- 
tion U(TT,(p,y) and the boundary h*(y) satisfy the conditions in f !3.28|) and (I3.29p . it follows 
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from the expression in (13.361) and the structure of the stopping time in (I3.26f) that the equalities: 



r*Ar n 



U (V T „ ATn , 0t,at„, K«atJ + / (1 - 7T t ) ca>(j) t dt = U (tt, 0, y) + M r „ ATn (3.41) 

hold for all (ir,<f),y) G [0,1) x (0, oo) x R and any localizing sequence (r n ) ng N of M. Hence, 
taking into account the assumption that the integral in (12.171) taken up to r* is of finite 
expectation and using the fact that < U(ir, 0, y) < 1 holds, we conclude from the expression 
in (13.41 j) that the process {M TtM ) t > is a uniformly integrable martingale. Therefore, taking 
the expectations in (I3.41j) and letting n go to infinity, we apply the Lebesgue dominated 
convergence theorem to obtain the equalities: 



E j. 



Ett 



r* 



7T Tt + / (1 - 7T t ) COt(j) t dt 



(3.42) 



U(n Tt ,(f) Tt ,Y Tt ) + (1 -n t )ca4>tdt 



U(-K,(f),y) 



for all (Tr,(j),y) G [0,1) x (0, oo) x R, which together with the inequalities in ( 13.401) directly 
imply the desired assertion. □ 

3.8. We are now in a position to formulate the main assertion of the paper, which fol- 
lows from a straightforward combination of Lemma 3.3 above and standard change-of-variable 
arguments. More precisely, after obtaining the solution U*(tc, (fi,y) = (1 — 7r)H*(<f>, y; z) with 
h*(y) = h*(y; z) of the free-boundary problem in (l3.28[) -( T3.31j) . which satisfies the conditions in 
( I3.32p -( l3~34l) . we put y = y(ii, x; z) and z = x, in order to get the solution of the initial quickest 
detection problem with exponential penalty costs for a detection delay stated in ( 12.171) . 

Theorem 3.4. Suppose that the assumptions of Lemmas 3.1 and 3.3 hold. Then, in 
the quickest disorder detection problem of {2.11 ) for the observation process X from {2. 1\) . the 
B ay esian risk function takes the form K(vr,0, x) = U*(n,(fi,y((f),x)) = (1 — 7r)if :( ,(0, y((f), x; x); x) 
and the optimal stopping boundary < \/(ca) < g*(x) in ^3. 151) satisfying {3.16]) is uniquely 
determined by the equation g(x) = h*(y(g(x) , x)) = h*(y(g(x), x; x); x) , for each x > fixed. 
Here the function [/*(7r,0, y) = (1 — Tr)H*((j),y; z) and the continuous boundary of bounded 
variation h*(y) = h*(y\ z) form a unique solution of the free-boundary problem in Ii3. 28\) - [3.34\ ), 
and the expression for y(<f), x) = y(<f), x; z) is explicitly determined by the relation in {3.241 ), f or 
all (tt, 0, y) G [0, 1) x (0, oo) x R and any z > fixed. 

Remark 3.5. Observe that the optimal stopping time in the problem of (12.171) does not 
depend on the dynamics of the process (7r t ) 4 > , so that the two-dimensional process (0 t ,X 4 ) 4 > o 
turns out to be a sufficient statistic. This fact is recognized as a consequence of the structure 
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of the partial differential equation in ( 13.1 7j) -( t37T8|) . However, the process (0 t ,X t ) t > o is not 
Markovian, and thus, in order to solve the optimal stopping problem of (12. 17ft . we need to add 
the component (itt)t>o and then operate with the resulting Markov process (n t , <fi t , X t ) t >o. 

Let us now give a short note concerning the case of bounded signal/noise ratio function 
p{x) from ( 13~T2D . 

Remark 3.6. Suppose that there exist some < p < ~p < oo such that p < p(x) < ~p 
holds for all x > 0. Let us denote by V_*(ir, 0, x) with g (x) and by V*(tt, 0, x) with g*(x) the 
solution of the Bayesian quickest disorder detection problem with exponential delay penalty, 
under p(x) = p and p{x) = p, respectively. In those cases, the problem of (12. 17ft degenerates 
into an optimal stopping problem for the two-dimensional Markov process (irt,<t>t)t>o, and the 
value functions V^(ir, 0, x) = V_^(n, 0) and V*(ir, <fi, x) = V*(tt, <fi) with the stopping boundaries 
g (x) = and g*(x) = h* are given by the expressions in (I3.55P and (I3.54|) below, whenever 
T] — 1/p and rj = 1/p, respectively. Taking into account the properties of the boundary g#,(x) 
in (I3.16P and the fact that V*(ir,<p,x) = 1 — tt for all <fi > g*(x) and < n < 1, we therefore 
conclude by standard comparison arguments that the inequalities V*(ir,<f)) < V*(tt, <fi, x) < 
V^(tt, 0) and thus < X/(ca) < < g*{x) < h* hold for all (n, 0, x) G [0, 1) x [0, oo) x (0, oo) . 

3.9. In order to pick up some special cases in which the free-boundary problem in (13. 28ft - 
(I3.34p can admit a simpler structure, for the rest of the section, in addition to the conditions 
in (12. 2p . we suppose that the property: 

T1{(t'^ (^) 

Pi(x) = — for some rji G R, i = 0, 1, such that r] ^ r)\ and r] Q + rji = 1 (3.43) 

x 

holds for all x > 0. Moreover, we assume that the diffusion coefficient cr(x) satisfies: 

a(x) ~ A x a as x 1 and a(x) ~ x 13 as x t oo (3.44) 

with some Aq, > and a, f3 G R such that (1 — a)r] < and (1 — P)rj > holds, where 
we set r) — 1/(771 — rjo) . In this case, the process Y = (Y t ) t > takes the form: 

1 X /"' / A \ 1 

Y t = log <fi t log — = log 0+/ ( - — h A + a ) ds with rj = (3.45) 

V z Jo V0 S / V1-V0 

for any z > fixed. It is easily seen from the structure of the expression in ( 13. 45ft that the 

one-to-one correspondence between the processes (ir t , (fit, X t )t>o and (ir t , (fit, Yt)t>o remains true 

in this case. Hence, getting the expression for X t from ( 13.451) and substituting it into the 

equations of (12 . 13[) and (12.191) . we obtain: 

a(ze~' nYt (fi n ) — 
dir t = A(l - Tit) dt + ^ — ^ 7r t (l - Tit) dB t (3.46) 
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with 7Tq = ii and 



2( - V YtAV\ \ ( -r,Y t ±p\ 

A + (A + *)<k + 2 7 2 Ji *t <Pt)dt+ a[Ze fjj 0, dB t (3.47) 



with 0o — 0) for any 2; > fixed. Applying Ito's formula to the expression in (13.451) and taking 
into account the representations in ( 12. 13ft and ( 12. 15ft as well as the assumption of (I3.43[) . we 

get: 

dY t = ( A + A + a J dt (3.48) 



with lo = V ■ It thus follows that the infinitesimal operator L( 7r ^ i y) from (I3.27P takes the form: 

d ( . w a\ze-^^) \ d 



L(^n = A(l - 7r) — + ( A + (A + a)(j) + z^z^ * ) — (3.49) 



for all (7r, 0, y) G [0, 1) x (0, 00) x R and any z > fixed. 

3.10. Let us now introduce the function U (it, 0, y) = (1 — ir)H(<j), y) and the boundary 
as a solution of the free-boundary problem consisting of the differential equation: 

(jA + (A + a)0) — + - 2 ^^<P 2 W -^y<P,y) = -ca ( p for < %) (3.50) 

instead of the one in ( 13.28D . for each y > fixed, and the conditions of ( I3.29p -( I3~3T|) as well as 
( I3.32p -( l3~34"l) . The general solution of the resulting second-order ordinary differential equation 
in (I3.50P takes the form: 

H{<f>, y) = C (y) F o (0, y) + C^y) ^(0, y) - c(l + 0) (3.51) 

where Hi(<f),y), i = 0, 00, form a system of fundamental positive solutions (i.e. nontrivial 
linearly independent particular solutions) of the corresponding homogeneous differential equa- 
tion, and Ci(y) , i = 0, 00, are some arbitrary continuously differentiable functions, so that the 
condition in (13.341) holds. By virtue of the assumptions of (12. 2p and taking into account the 
arguments from [10[ Section 4], we can identify by H (<f),y) a decreasing solution that has a 
singularity at zero and by H^tp, y) an increasing solution that has a singularity at infinity. 

Observe that we should have Co(y) = in ( I3.51|) . since otherwise U(ir,<f),y) = (1 — 
7r)H((f), y) ±00 as J, 0, that must be excluded by virtue of the obvious fact that the 
value function in (I3.25P is bounded at = 0, for any fixed. Then, applying the condi- 

tions of (I3.29p and (13.321) to the function in (I3.5ip with Co(y) = 0, we get that the equalities: 



dH 

C 00 (y)H 00 (h(y),y) = c(l + h(y)) + l and C^y) -^(0, y) 



17 



= c (3.52) 

<f>=h(y) 



hold for y G R fixed. Hence, solving the equations of (13.521) . we get that the solution of the 
system of (13301) with ( Km and (13T32D - ( 13331) is given by: 

H(<fi, y; %)) = (c(l + %)) + 1) / 7 t ( f \ y) - - c(l + 0) (3.53) 

for all < 4> < h(y), so that < H((j),y;h(y)) = H(<j),y; z; h(y; z)) < 1 holds, where h(y) 
satisfies the equation: 



dHoo 



cHoa(h(y),y) ^ ^ 



0=/l(y) c(i + /i(y)) + 1 

for any y G R fixed. 

Taking into account the facts proved above, let us formulate the following assertion. 

Corollary 3.7. Suppose that n%{x), i — 0, 1 ; and cr(x) > are continuously differentiable 
functions on (0, oo) m (OQJ) satisfying $2.2\) and A,3.43\ )- [3.44\ ) w ith a, f3 G R snca i/iai (1 — 
a)r/ < and (l — /3)r) > 0, where r] = 1/(771—770)- Assume that h(y) provides a unique solution 
of the equation in \3. 54\) for all y G R. Taen, using £/ie same arguments as in the proof of 
Lemma 3. 3 above, it is shown that the function: 

~ (#(0,y;%)), z/O<0<%) 

U{* t hv) = {l-*)H(<j>, y ) with H( ( f>,y)={ ^' y ' (3.55) 

(1, if 0>%) 

coincides with the value function of the optimal stopping problem: 

Ufa fry) (3.56) 
= inf K 



tt t + / (1 - 7r t ) ( c«0 t - I A + A + a ) ^(&, K t ) < W)) ) * 



<9y 

which corresponds to the Bayesian risk function in A3. 25\) . Moreover, h(y) = fo(y; z) determined 
by flff. 54 ) provides a hitting boundary for the stopping time: 

? = M{t >0\<f)t> h(Y t )} (3.57) 

which turns out to be optimal in A3. 56\) whenever the integral above is of finite expectation, and 
t = otherwise, for any z > fixed. 

Remark 3.8. Note that the function [/(71", 0, y) in (I3.56P and the boundary h(y) in (I3.57P 
provide lower (upper) and upper (lower) estimates for the initial value function U*(ir,<f>,y) in 
(I3.25P and the optimal stopping boundary h*(y) in (I3.26p . whenever the function y i-)- H(cj),y) 
is increasing (decreasing) on R. According to Remark 3.6 above and the structure of the 
change of variables in (13.241) . such a situation occurs when p(x) from (13.121) is an increasing 
(decreasing) function on (0, 00) and r] < 771 (770 > 771) in ( I3.43p . respectively. 
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4. The case of linear delay penalty costs 

In this section, we provide some results, which are related to the quickest detection problem 
with linear delay penalty costs of Example 2.2 above. 

4.1. Following the arguments of Subsection 3.1 above and applying Doob's optional sampling 
theorem, we get from (13. 2 j) that the equality: 



PT ~] PT 

1 - 7T T + / (1 - 7T t ) Oft dt = 1 — 7T + -Ett^x / (1 - 7T t ) (c<£> t - A) (4.1) 



holds for all (7r, a;) G [0, 1) x [0, oo) x (0, oo) and any stopping time r satisfying E nmx < oo. 
Taking into account the structure of the reward in fl 2 . 1 6 j) . it is also seen from (14.1 ft that it is 
never optimal to stop when ip t < A/c for any t > 0. This shows that all the points (ir,(p,x) 
such that ip < X/c belong to the continuation region: 

C = {(ti, ip, x) G [0, 1) x [0, oo) x (0, oo) | V'{tt, p, x) < 1 - tt}. (4.2) 

Then, combining the arguments in [271 Chapter IV, Section 3] with the ones in Subsection 
3.2 above, we obtain that the continuation region in (14. 2p for the optimal stopping problem of 
(I2.16P takes the form: 

C = {(tt, <p, x) G [0, 1) x [0, oo) x (0, oo) | <p < g'(x)} (4.3) 

so that the corresponding stopping region is the closure of the set: 

D' = {(tt, (p, x) G [0, 1) x [0, oo) x (0, oo) | (p > g'{x)}. (4.4) 

4.2. In order to characterize the behavior of the boundary g'(x) in (14 .3ft - (14.41) . we observe 
from the equation in ( 12. 121) that the expression: 

{l-7T t )tp t dt= / —-tdtpt- / — ^ — ~ (A + p{X t ) 7i t ipt) dt + N' T , (4.5) 



o jo A Jo A 

holds for the optimal stopping time t' = t'(tt,<p,x) in (12.161) such that (tt,<p,x) G C . Here 
the process N' = (Nj.) t > defined by: 

Jo cr(^sj A 

is a continuous local martingale under P n ^ tX , and the function p(x) is given by (I3.12p . Note 
that the assumption that E ntlfitX r' < oo holds and the third inequality in (12.21) yield that the 
integral in the left-hand side and the second integral on the right-hand side of (14. 5p are of finite 
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expectation. Moreover, by virtue of the facts that (1 — 7Tt)pt = TTt and < 7r t < 1 holds for all 
t > 0, and taking into account the third inequality in ( 12. 2ft . we see from (14. 6B that the process 
(N^, At ) t >o is a uniformly integrable martingale under P n ^^ x . Then, applying Doob's optional 
sampling theorem, we get from the expression in ( 14. 5 ft that: 

/r' pt' ^ pt 1 ^ 

(1 - 7r t ) (ft dt = E n}lfitX J — j-t dipt - E Wjip>x j — - — - (A + p(X t ) ir t (p t ) dt (4.7) 

is satisfied. Let us now take x' > such that x < x' and recall the fact that (7r t , <p t , X t ) t >o 
is a time-homogeneous Markov process. Assume that (jr,p,x) £ C is chosen sufficiently close 
to the stopping boundary g'(x), and note that r' = t'(7t, tp, x) does not depend on x' . Hence, 
by means of the comparison results for solutions of stochastic differential equations, we obtain 
that the expression in ( 14. 7ft yields: 



V'(lT, if, x') — (1 — 7r) < En,<p,x> 

< E 7 



J 7V,(p,X 



1 - 7T T , + / (1 - 7T t ) apt dt 
Jo 

PT* 

L - 7Tr» + / (1 - 7T t ) Cp t dt 







(4.8) 

V'{Tr,(p,x)-{l-Tr) 



whenever p(x) is an increasing function on (0, oo) . By virtue of the inequality in (14. 8B . we may 
therefore conclude that (ir,(p,x r ) G C", so that the boundary g'(x) is increasing (decreasing) 
in (I4.3p - ()4.4p whenever p(x) is increasing (decreasing) on (0,oo), respectively. 

Summarizing the facts proved above, we now formulate the assertions related to the Bayesian 
quickest detection problem with linear penalty costs for a detection delay, which are proved 
using the arguments from the previous section. 

Lemma 4.1. Suppose that Pi(x) , i = 0,1, and o~(x) > are continuously differentiable 
functions on (0, oo) in A2. 1\) satisfying ( dJ| ). Then the optimal Bayesian time of alarm r' in 
the quickest disorder detection problem A2.16\) has the structure: 

r' = mf{t>0\p t >g'(X t )} (4.9) 

whenever E njV}X 7 J < oo holds, for all (jr, p, x) £ [0, 1) x [0, oo) x (0, oo) , and r' — otherwise. 
Moreover, the property: 

g\x) : (0, oo) (A/c, oo) is increasing / decreasing if p(x) is increasing/decreasing (4.10) 

holds with p(x) defined in A3. 12]) , for all x > . 

Theorem 4.2. Suppose that the assumptions of Lemmas 4-1 and 3.3 hold with <p = p, 
a = in A3. 21), and a = 1 in A3. 28]) . Then, in the quickest disorder detection problem of 
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$2.16\) for the observation process X from \2. the Bayesian risk function takes the form 
V'(ir,<p,x) = U'(ir,<p,y((p,x)) = (1 — 7r)H'({p,y({p,x;x)]x) and the optimal stopping boundary 
< A/c < g'(x) in satisfying M-lOj ) is uniquely determined by the equation g(x) = 

h'(y(g(x),x)) = h r (y(g(x),x;x);x) ! for each x > fixed. Here the function U r (ir,<p,y) 
: 1 — 7r)H'(<p,y; z) and the bounded continuous boundary of bounded variation h'(y) = h'(y; z) 
form a unique solution of the free-boundary problem in ( [<?. 28\) - [3.34\ ), and the expression for 
y(tp,x) = y(ip,x;z) is explicitly determined by the relation in \3.2J$ with <p = ip , for all 
(n, <f, y) G [0, 1) x (0, oo) x R and any z > fixed. 

Remark 4.3. Suppose that there exist some < p < p < oo such that p < p(x) < p holds 
for all x > 0. Let us denote by V!(n, ip, x) with g'{x) and by V\ir, <p, x) with g'(x) the solution 
of the Bayesian quickest disorder detection problem with linear delay penalty, under p(x) = p 
and p(x) = p, respectively. In those cases, the problem of (I2.16P degenerates into an optimal 
stopping problem for the one-dimensional Markov process (7r t ) t > being equivalent to (<Pt)t>o, 
and the value functions V^(tc, ip, x) = Vf(ir, ip) = Yli^l (1 + V 9 ); V 9 ) an d V ( n i V 9 ; x ) = V l 71 "? v) = 
v'(ip/(l + v 9 )^) with the stopping boundaries g'(x) = hf and g~'{x) = h are given by the 
expressions in (14. 15|) and (14.141) below, whenever 77 = 1/p and rj = 1/p, respectively. Taking 
into account the properties of the boundary g'(x) in (14.101) and the fact that V'(jr, <p,x) = 1 — tt 
for all (p > g'(x) and < tt < 1, we therefore conclude by standard comparison arguments 
that the inequalities v'(ir,<p) < V'(7r,tp,x) < Vf(7r,<p) and thus < A/c < hf < g'(x) < h 
hold for all (ir, tp, x) G [0, 1) x [0, 00) x (0, 00) . 

4.4. Let us finally introduce the function U((p/(1 + (p),<p,y) = G(ip,y) and the boundary 
h(y) as a solution of the free-boundary problem consisting of the differential equation: 

W1 .OG a 2 (ze~^^) f V 2 8G <p 2 d 2 G\\, , ap . N lA 

instead of the one in (I3.28p . for each y > fixed, and the conditions of (I3.29p - (l3.3ip as well as 
(I3.32p - (l3.34p with <fi = ip and 7r = ip/(l + <p) . The general solution of the resulting first-order 
linear ordinary differential equation for ip 1— > (dG/dip)((p,y) takes the form: 

— (^ y =— ^-exp / v 2 ' 1 du) 4.12 

dip (1 + ip) 2 xJ^ u a 2 (ze Wu 71 ) J 

f c(l + u) 2r] 2 z 2 e" 2 ^u 2tl ( f v A(l + v) 2rfz 2 e- 2 ^v 2ri , \ , 

exp — / - — — — dv du 



! u(l + (p) 2 ^(ze-wu 7 !) \ J u v 2 o- 2 (ze"W) 

where C(y) is an arbitrary continuously differentiable function, for each )/Gl and any z, w > 
fixed. By virtue of the assumptions of (12. 2p . we see that the term in the first line of (I4.12p 
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above tends to infinity as <p j. 0, so that (dG/d<p)(ip,y) — > ±00 as C(y) 7^ 0, for any y e R 
fixed. We should thus choose C(y) = 0, that is equivalent to the property in ( 13 .331) . Hence, 
integrating the equation in (14.12j) . we therefore obtain that the solution of the system of (14. lip 
with ( jPHD and fl332D -f lQ3D is given by: 

G( V ,y;h(y)) = 1/(1 + h(y)) (4.13) 
+ / / ~k ^ ■>, ^ exp - / - '— — - cfo rfwrfw 
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o w(l + w) 2 a 2 (ze- r >yu r >) \ J u v 2 o 2 (ze-^v r i) 



for all < ip < h(y), so that < G(ip,y;h(y)) = G(ip,y; z; h(y; z)) < 1/(1 + y?) holds, where 
h(y) satisfies the equation: 

h{y) c(l + u) 2 V 2 z 2 e- 2riy u^ ( _ [ h M \(l + v) 2 V 2 z 2 e- 2 ™v 2ri \ 



exp - / — — 7, — — ^77 -dv)du=l (4.14) 

u a 2 (ze-^u^) \ Ju v 2 a 2 (ze-Wvv) J 

for each t/6l and any z > fixed. 

Summarizing these facts above, let us formulate the following assertion. 

Corollary 4.4. Suppose that Hi(x) , i — 0,1, and c(x) > are continuously differentiable 
functions on (0, 00) in Ii2.1\) satisfying h2.2\) and ^3.43\ )- (3.44\ ) w ^h a, (3 G M. such that (1 — 
a)rj < and (1-/3)7/ > 0, where rj = 1/(i]i — i]q) . Assume that h(y) provides a unique solution 
of the equation in l[4-14\ ) f or all y £ Then, using the same arguments as in the proof of 
Lemma 3. 3 above, it is shown that the function: 

G(cp,y;h(y)), if < ip < h(y) 
U(ir, V ,y) = G(<p,y)={ W " _ (4.15) 

1/(1 +<p), if<f>h(y) 



coincides with the value function of the optimal stopping problem: 



U (7r, <p, y) = inf E n 



tt-+ f (^-(-+Af(^K)Hn < mi) * 

l + <Pr Jo \l + ¥t \<pt J oy J _ 



(4.16) 



with 7r = tp/(l + (p), which corresponds to the Bayesian risk function in A2.16}) . Moreover, 
< A/c < h(y) = h(y; z) determined by \4-^4\) provides a hitting boundary for the stopping 
time: 

T = M{t>Q\<p t >h{Y t )} (4.17) 

which turns out to be optimal in M-lOj) whenever the integral above is of finite expectation, for 
any z > fixed. 

Remark 4.5. Note that the function U(n,(p,y) in (I4.16I) and the boundary h(y) in (I4.17P 
provide lower (upper) and upper (lower) estimates for the initial value function U'(ir,(p,y) 
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defined as in (13. 25ft with a = 1 and the optimal stopping boundary h'(y) defined as in ( 13. 26ft 
with (j) — (p, whenever the function y y G((p,y) is increasing (decreasing) on K. According to 
Remark 4.1 and the structure of the change of variables in fl3.24f) with = <p, such a situation 
occurs when p(x) from ( 13.121) is an increasing (decreasing) function on (0, oo) and t]q < r/i 
(Vo > Vi) i n (13.431) . respectively. 
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